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Tide: A Computer System Having A iMuItimedia Bus and Comprising a Centralized I/O 

Processor which Performs intelligent Data Transfers 

5 BACKGROUND OF THE fN VENTION 

Field of the invention 

The present invention relates to a computer system which includes a system expansion bus such as the 
Peripheral Component interconnect (PCI) bus and/or also includes a separate real-time or multimedia bus which 
1 0 transfers periodic and/or multimedia stream data, wherein the system includes a centralized I/O processor which 
controls transfer of stream data for increased system performance. 

Description of the Related Art 

1 5 Computer architectures generally include a plurality of devices interconnected by one or more various 

buses. For example, modem computer systems typically include a CPU coupled through bridge logic to main 
memory. The bridge logic also typically couples to a high bandwidth local expansion bus or system expansion 
bus, such as the peripheral component interconnect (PCI) bus or the VESA (Video Electronics Standards 
Association) VL bus. Examples of devices which can be coupled to local expansion buses include video 

20 accelerator cards, audio cards, telephony cards, SCSI adapters, network interface cards, etc. An older type 
expansion bus is generally coupled to the local expansion bus for compatibility. Examples of such expansion 
buses included the industry standard architecture (ISA) bus. also referred to as the AT bus. the extended 
industry standard architecture (EISA) bus, or the microchannei architecture (MCA) bus. Various devices may 
be coupled to this second expansion bus. including a fax/modem, sound card, etc. 

25 Personal computer systems were originally developed for business applications such as word 

processing and spreadsheets, among others. However, computer systems are currently being used to handle a 
number of real time applications, including multimedia applications having video and audio components, video 
capture and playback, telephony applications, and speech recognition and synthesis, among others. These real 
time applications typically require a large amount of system resources and bandwidth. 

30 One problem that has arisen is that computer systems originally designed for business applications are 

not well suited for the real-time requirements of modem multimedia applications. For example, modem 
personal computer system architectures still presume that the majority of applications executing on the 
computer system are non real-time business applications such as word processing and/or spreadsheet 
applications, which execute primarily on the main CPU. In general, computer systems have not traditionally 

35 been designed with multimedia hardware as pan of the system, and thus the system is not optimized for 
multimedia applications. Rather, multimedia hardware is typically designed as an add-in card for optional 
insenion in an expansion bus of the computer system, wherein the expansion bus is designed for non-realtime 
applications. 

In many cases, multimedia hardware cards situated on an expansion bus do not have the required 
40 system bus bandwidth or throughput for multimedia data transfers. For example, a multimedia hardware card 
situated on the PCI expansion bus must first arbitrate for control of the PCI bus before the device can begin a 
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data transfer or access the system memor>'. In addition, since the computer system architecture is not optimized 
for multimedia, multimedia hardware devices are generally required to share bus usage with non-real lime 
devices. 

Also, multimedia hardware devices generally do not make efficient usage of system resources. As an 
example, multimedia hardware cards typically include their own memory in addition to system memory. For 
example, video accelerator cards are typically configured with one to four Megabytes of video RAM. Audio 
cards, video capture cards, and other multimedia cards are also generally configured with dedicated on-board 
memory. This requirement of additional memory adds undesirable cost to the system. 

As multimedia applications become more prevalent, multimedia hardware will correspondingly 
become essential components in personal computer systems. Therefore, an improved computer system 
architecture is desired which is optimized for real-time multimedia and communications applications as well as 
for non-realtime applications, in addition, improved methods are desired for aansferring real-time data between 
multimedia devices. 

Applicant is aware of two new graphics standards from the Video Elecnronics Standards Association 
(VESA) which are designed to improve digital video n-ansfers in computer systems. These two standards arc 
referred to as the VESA advanced feature connector (VAFC) and the VESA media channel (VMC). A third 
standard has been proposed by Intel and ATI referred to as the shared frame buffer interconnect (SFBI). 

The VAFC standard is a 32 bit replacement for prior 8 bit VGA connectors which supports video at 
much higher resolutions and in better color. The VMC standard also offers a 32 data path and supports up to 15 
video sn-eams simultaneously. The VMC standard comprises a dedicated channel for real-time video, and 
peripherals can communicate independently without slowing the system CPU. The VMC standard also 
decouples the memory subsystem from the video transfer specification, allowing graphics board manufacmrers 
to offer a variety of boards with differing types of graphics memory. 

The SFBI standard combines frame buffers and memory use by each multimedia system into a single 
shared memory pool. The SFBI standard also includes a protocol for arbitrating among devices attempting to 
access the memory. However, one drawback to this standard is that the standard is designed to maintain all of 
the components on a single board. The SFBI standard does not provide an external feature connector unless 
SFBI cards are connected to another over the host bus. In addition, SFBI cards can include a VMC or VAFC 
connector for connecting to a VMC or VAFC card. 

Summary of the Invention 

The present invention comprises a computer system and method optimized for real-time applications 
which provides increased performance over current computer architectures. The system preferably includes a 
standard local expansion bus or system bus, such as the PCI bus, and also includes a dedicated real-time bus or 
multimedia bus. Thus multimedia devices, such as video devices, audio devices, etc.. as well as 
communications devices, n-ansfer real-time data through a separate bus without requiring arbitration for or 
usage of the PCI bus. The computer system of the present invention thus provides much greater performance for 
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real-time applications than prior systems. In an alternate embodiment, the computer system only includes one or 
more dedicated real-time buses which replace the PCI bus. 

In the preferred embodiment, the computer system comprises a CPU coupled through chip set or 
bridge logic to main memory. The bridge logic couples to a local bus such as the PCI bus. The computer 
5 system also includes a real-time expansion bus or multimedia bus for transferring real-time or multimedia data. 
A plurality of multimedia devices, such video devices, audio devices. MPEG encoders and/or decoders, and/or 
communications devices, are coupled to each of the PCI bus and the multimedia bus. In one embodiment, the 
multimedia bus transfers only periodic stream data, such as audio data at 44.100 samples per second, video data 
at 30 frames per second, or real-time communication streams at rates dependent on the n-anspon media. 
10 "Tlie computer system preferably includes a plurality of PCI expansion bus connector slots connected to 

the PCI bus for receiving add-in devices, and also preferably comprises one or more multimedia bus connector 
slots corresponding to respective ones of the PCi expansion bus connector slots. Thus, in one embodiment, the 
PCI bus and the multimedia bus are comprised on the motherboard and include respective connector slots for 
receiving add-in cards. Multimedia device expansion cards each include two connectors which correspond to 
1 5 the PCI bus and the multimedia bus. Alternatively, the multimedia devices are comprised directly on the 
motherboard and connect directly to the PCI bus and the multimedia bus. and connector slots are not used. 

In one embodiment, the multimedia bus comprises primarily or only data lines. In this embodiment, 
control information for the periodic stream transfers is n-ansferred on the PCI bus by a sourcing device, or is 
transferred by the CPU to the bridge logic. Thus multimedia data transfers initially involve the transfer of * 
20 control or setup information on the PCI bus. or transfer of conn-ol or setup information by the CPU, to set up the 
transfer. This transfer of control infonmation is followed by the n-ansfer of the periodic data sn^eams on the 
multimedia bus. Alternatively, once control/setup information has been used to set up the transfer, the periodic 
data stream may occupy both the PCI data lines and the multimedia bus for increased data throughput. In this 
embodiment, the transferring or source device transfers a multiple bus transfer request which requests 
25 simultaneous transfers on both the PCI bus and the multimedia bus. If the multiple bus transfer request is 
accepted, then the source device n-ansfers data on both the PCI bus and the multimedia bus. 

The present invention further includes an improved method for transferring periodic data streams on a 
bus in the computer system, such as periodic video streams or periodic audio streams. According to this 
method, the n^nsferring device first transmits addressing and control information to set up the transfer. The 
30 transferring device then transmits a periodic n-ansfer data request to the receiving device. The periodic transfer 
data request includes information regarding the frequency and amoum of the periodic transfers. The receiving 
device determines if it can guarantee availability at the periodic time frequencies requested by the transferring 
device. If the receiving device indicates availability for the periodic n-ansfers, the transferring device sets a 
periodic n^nsfer flag. The transferring device then performs the periodic transfers to the receiving device at the 
35 specified time frequency. If the receiving device does not indicate availability for the periodic transfers, the 
transferring device performs only a single transfer and is required to transfer conn-ol information at the 
beginning of each subsequent periodic n-ansfer. 

In a second embodiment, the computer system includes a dedicated control channel separate from the 
PCI bus and the multimedia bus for transferring control information for multimedia bus data transfers. The 

3 
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control channel is preferably a serial bus. Alternatively, the control channel is a 4-bit. 8-bit or 16-bit bus. Thus 
a multimedia data transfer initially involves the transfer of control information on the dedicated .control channel 
followed by the transfer of the periodic data streams on the multimedia bus. 

In a third embodiment, the multimedia bus comprises separate channels for different data types. In the 
preferred embodiment, the computer system includes a first video data channel for transferring video and/or 
graphics information, a second audio channel for transferring audio information, and optionally a third channel 
for transferring communications information. The video channel is preferably 32 bits, 24 bits, or 16 bits. 
Alternatively, the video channel is an S-bit bus or a very high speed serial bus. The audio channel is preferably 
16 bits or 8 bits. Alternatively, the audio channel is also a 32-bit bus or a very high speed serial bus. The 
communications channel is also preferably either 16 or 8 bits. This third embodiment may use the PC! bus for 
control information transfers, or may use a separate control channel separate from the PCI bus and the 
multimedia bus for transferring control information for the periodic stream transfers. 

In a fourth embodiment, each multimedia device has a high speed link directly to system memory, 
which is preferably single or multiple poned memory. These individual links are preferably high speed serial 
interconnects but, alternatively, may be 4.bit, 8-bit. 16-bit, 24-bit, 32-bit. 64-bit or any combination thereof In 
this embodiment, intelligent buffering is preferably implemented within the core logic, and arbitration for 
access to main memory is preferably implemented within the core logic. Each of the multimedia devices uses its 
dedicated memory data channel to perform data accesses and transfers directly to the mam mcmor\', bypassing PCI 
bus arbitration and PCI bus cycles. Alternatively, each of the multimedia devices includes a high speed memorx' 
channel directly to the memory controller in the core logic for accessing system memory. 

In a fifth embodiment, the multimedia bus is time sliced wherein time slices or time slots are allocated 
in proponion to the required bandwidth. In one embodiment, the time slices are each a constant size and a 
number of the equal sized time slots are allocated to respective data streams in proponion to the required 
bandwidth, in this embodiment, for example, video data streams may be allocated more time slots than audio 
data streams because of the increased data transfer band width requirements of video streams. Alternatively, the 
time slots are not equally sized, but rather are dynamically sized or allocated to data streams in proponion to the 
required bandwidth. 

In a sixth embodiment, multimedia devices that connect to the multimedia bus include intelligent 
controller circuitry which includes knowledge of the respective time slice allocated to the multimedia device. In 
this embodiment, arbitration for the multimedia bus is not requu-ed. Rather, a multimedia device which is a 
transmitter of video data monitors the bus and includes controller circuitry which begins transmitting the video 
data when the device^s respective time slot occurs. A corresponding receiver device also knows that the current 
time slot is a video time slot and monitors the bus to receive the data. 

in this embodiment, the interface circuiny of each of the multimedia devices are programmed at boot 
time for a static allocation of time slots. Alternatively, the interface circuitry in the multimedia devices is 
dynamically programmed by a central controller dependent upon the mix of real-time processes and 
applications and the conresponding data transfer bandwidth requirements. For example, the CPU may program 
each of the multimedia devices with a respective time slot at power-on. Altematively, the CPU dynamically or 
heuristically allocates time slot based on bandwidth requirements. 

4 
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In one embodiment of the invention, the computer system includes a centralized multimedia I/O 
processor which operates lo direct or "pull" data stream information through the system. The multimedia I/O 
processor is programmed with knowledge of the various data rates, data periodicir>', data sources and 
destinations, and coordinates all transfers within the system. Thus, the multimedia I/O processor creates 
connections between two or more devices and sets up transfers between devices. The centralized multimedia 
I/O processor of the present invention may be used exclusively in the multimedia bus or may be used on a 
standard PCI bus. 

In one embodiment, the centralized multimedia I/O processor byte slices the multimedia bus to allow 
different data streams to use different byte channels simultaneously. Thus the byte sliced multimedia bus 
allows different peripherals to share the bus simultaneously. The centralized multimedia I/O processor thus may 
assign one data stream to a subset of the total byte lanes on the multimedia bus, and fill the unused b>'te lanes 
with another data stream. For example, with a 32-bit multimedia bus. if an audio data stream is only 16 bits 
wide and thus only uses half of the multimedia data bus, the multimedia bus intelligently allows data sn-eam 
n-ansfers on the unused bits of the bus. In this embodiment, the centralized multimedia I/O processor includes 
knowledge of the destinations and allows transfers to occur without addressing information. 

In one embodiment of the invemion, the computer system includes a multimedia memory coupled to 
each of the PCI local expansion bus and the real-time bus. One or more multimedia devices may be coupled to 
the PCI local expansion bus and the real-time bus. Each of these devices accesses the multimedia memory to 
retrieve necessary code and data to perfonn respective operations. The multimedia devices preferably include 
an arbitration protocol for accessing the multimedia memory using the real-time bus. 

In one embodiment, the system bus (preferably PCI) implements a new mode. of operation specifically 
for real-time transfers, A signal (or signals) is used to indicate that the system bus should be placed in a special 
real time mode. When not in special real time mode, the system bus operates as usual. The real time mode is 
optimized for the transfer of high bandwidth real-time information. 

Therefore, the present invention comprises a novel computer system architecture and method which 
provides one or more real-time or multimedia buses, optionally with a local expansion bus, to increase the 
performance of real-time peripherals and applications. The multimedia bus of the present invention provides 
improved data transfers performance and throughput for real-time devices. The various embodiments discussed 
above may be combined in various ways for optimum real-time and/or multimedia performance. 

Brief Description of the Drawings 

A better understanding of the present invention can be obtained when the following detailed 
description of the preferred embodiment is considered in conjunction with the following drawings, in which: 



Figure 1 is a block diagram of a computer system including a local expansion bus and a real-time bus 
or multimedia bus according to the present invention; 
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Figure 2 is a block diagram of a muitimedia device in the computer system of Figure I; 

Figure 3 A is a flowchart diagram illustrating a muliimedia bus transfer which uses the PCI bus for 
control and addressing information; 

Figure 3B is a flowchart diagram illustrating a multimedia bus transfer which uses both the PCI bus 
data lines and the multimedia bus data lines for improved bandwidth; 

Figure 3C is a flowchart diagram illustrating a multimedia bus transfer optimized for periodic data 

transfers; 



Figure 4 is a block diagram of the motherboard of the computer system of Figure I; 

Figure 5 illustrates a modular add-in card including a local expansion bus connector and a multimedia 
bus connector according to the present invention; 

Figure 6 is a block diagram of an alternate embodiment of the computer system of Figure 1; 

Figure 7 is a block diagram of a computer system including a local expansion bus and a real-time bus 
or multimedia bus and also including a dedicated control channel according to an alternate embodiment of the 
present invention; 



Figure 8 is a block diagram of a multimedia device in (he computer system of Figure 7; 

Figures 9A and 9B are flowchart diagrams illustratmg multimedia bus transfers in the computer system 
of Figure 7; 



Figure 10 is a block diagram of a computer system including a local expansion bus and separate 
multimedia channels for video, audio, and communications; 

Figure 1 i is a block diagram of an embodiment of the multimedia bus interface m the multimedia 
device of Figures 2 or 8 which includes time slot logic according to the present invention; 

Figure 12 illustrates various time slotting techniques; 

Figure 13 is a block diagram of a computer system including a local expansion bus and a real-time bus 
or multimedia bus and also including a centralized multimedia I/O processor; 
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Figure 14 is a block diagram of the centralized multimedia I/O processor of Figure 13; 



Figure 14a is a flowchan diagram illustrating operation of the byte slicing logic; 

Figure 15 is a block diagram of a computer system including a local expansion bus and a real-time bus 
and including a multimedia memory according to an alternate embodiment of the present invention: 

Figure 16 is a block diagram of the motherboard of the computer system of Figure 5: 

Figure 17 illustrates the address space of the main memory and the multimedia memory; 

Figure 18 is a flowchan diagram illustrating operation of data transfers from the main memory to the 
multimedia memory; 

Figure 19 is a block diagram of a computer system including a plurality of high speed memory 
channels for each peripheral device: 

Figure 20 is a block diagram of a multimedia device or multimedia device in the computer system of 
Figure 19; 

Figure 21 is a block diagram of a computer system having an expansion bus which includes a 
multimedia mode for high speed multimedia transfers; and 

Figure 22 is a block diagram of a multimedia device or multimedia device in the computer system of 
Figure 21. 

Detailed Description of the Preferred Embodiment 

incorporation by Reference 

PCI System Architecture by Tom Shanley and Don Anderson and available from Mindshare Press, 2202 
Buttercup Dr., Richardson, TX 75082 (214) 231-2216, is hereby incorporated by reference in its entirety. 

The Intel Peripherals Handbook, 1994 and 1995 editions, available from Intel Corporation, are hereby 
incorporated by reference in their emirety. Also, data sheets on the Intel 82430FX PCIset chipset, also referred to 
as the Triton chipset, are hereby incorporated by reference in their entirety, including the 82430 Cache Memory 
Subsystem dau sheet (Order No. 290482-004), the 82420/82430 PCIset ISA and EISA bridge data sheet (Order 
No. 290483-004). and the Intel 82430FX PCIset Product Brief (Order No. 297559-001 ), all of which are available 
from Intel Corporation, Literature Sales, P.O. Box 764 1, Mt. Prospect, IL 60056-704 1 (1-800-879-4683), and all of 
which are hereby incorporated by reference in their entirety. 
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The Video Electronics Standards Association (VESA) VESA advanced feature connector ( VAFC) 
specification and the VESA media channel (VMC) specification are hereby incorporated by reference in their 
entirety. 

The Intel-ATI shared frame buffer interconnect (SFB!) specification is also hereby incorporated by 
5 reference in its entirety. 

The PCI Multimedia Design Guide Revision 1.0, dated March 29, 1994, as well as later revisions, are 
hereby incorporated by reference in their entirety. 

Computer System Block Diagram 

1 0 Referring now to Figure I , a block diagram of a computer system according to the present invention is 

shown. As shown, the computer system includes a central processing unit (CPU) 102 which is coupled through a 
CPU local bus 104 to a hosl/PCI/cache bridge or chipset 106. The chipset 106 includes various bridge logic and 
includes arbin-ation logic 107. TTie chipset 106 is preferably similar to the Triton chipset available from Intel 
Corporation, including certain arbiter modifications to accommodate the real-time bus of the present invention. A 

1 5 second level or L2 cache memory (not shown ) may be coupled to a cache controller in the chipset 1 06, as desired. 
The bridge or chipset 106 couples through a memory bus 108 to main memory 110. The main memory 110 is 
preferably DRAM (dynamic random access memor>') or EDO (extended data out) memory, or other types of 
memory, as desired. 

The chipset logic 106 preferably includes a memory controller for interfacing to the mam memory 1 10 
20 and also includes the arbitration logic 107. The chipset logic 106 preferably includes various peripherals, including 
an interrupt system, a real time clock (RTC) and timers, a direct memory access (DMA) system, and ROM/Flash 
memory (all not shown). Other peripherals (not shown) are preferably comprised in the chipset 106, including 
communications pons, diagnostics ports, command/status registers, and non-volatile static random access memory 
OIVSRAM), 

host/PCI/cache bridge or chipset 1 06 also interfaces to a local expansion bus or system bus 1 20. In 
the preferred embodiment, the local expansion bus 120 is the peripheral component interconnect (PCI) bus 120. 
However, it is noted that other local buses may be used, such as the VESA (Video Electronics Standards 
Association) VL bus. Various types of devices may be connected to the PCI bus 120. 

The computer system shown in Figure 1 also includes a real-time bus, also referred to as a multimedia bus 
30 1 30. The multimedia bus 1 30 preferably includes a 32 or 64 bit data path and may also include address and control 
ponions. 

One or more multimedia devices or multimedia devices 142. 144, and 146 are coupled to each of the PCI 
bus 120 and the multimedia bus 130. One or more multimedia devices may connect to the PCI bus 120 only. The 
multimedia devices 142-146 include interface circuitry 1 70 which includes standard PCI interface circuitry for 
communicating on the PCI bus 120. For devices which also connect to the multimedia bus, the interface circuitry 
170 in the multimedia devices 142-146 also includes interface logic for interfacing to the multimedia bus 130. The 
multimedia devices 142-146 use the multimedia bus 130 to communicate data, preferably only periodic data, 
between the respective devices. 



35 
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The multimedia devices 142-146 may be any of various types of input/output devices, including 
multimedia devices and communication devices. For example, the multimedia devices 142-146 may comprise 
video accelerator or graphics accelerator devices, video playback devices, MPEG encoder or decoder devices, 
sound devices, network interface devices, SCSI adapters for interfacing to various input/output devices, such as 
CD-ROMS and tape drives, or other devices as desired. 

Thus, the multimedia devices 142-146 communicate with each other via the PCI bus 120 and also 
communicate with the CPU and main memory 1 10 via the PCI bus 120, as is well known in the art. The 
multimedia devices 142-146 also communicate data between each other using the real-time bus or multimedia bus 
130. When the multimedia devices 142-146 communicate using the real-time bus 130, the devices are not required 
to obtain PCI bus mastership and they consume little or no PCI bus cycles. 

Expansion bus bridge logic 150 may also be coupled to the PCI bus 120. The expansion bus bridge logic 
150 interfaces to an expansion bus 152. Tlie expansion bus 152 may be any of varying types, including the 
indusn^ standard architecture (ISA) bus, also referred to as the AT bus, the extended industry standard architecnire 
(EISA) bus. or the microchannel architecture (MCA) bus. Various devices may be coupled to the expansion bus 
152. such as expansion bus memory or a modem (both not shown). 

Multimedia Devices 

Referring now to Figure 2, a block diagram is shown illustrating one of the multimedia devices 142 - 146, 
such as multimedia device 142. As shown, the multimedia device 142 includes interface logic 170 comprising PCI 
interface circuitry 172 for communicating on the PCI bus 120 and also including multimedia bus interface logic 
1 74 for interfacing to the multimedia bus 130. The multimedia device 1 42 also may include a digital signal 
processor (DSP) 2 1 0 or other hardware circuitry for implementing a multimedia or communications function. Each 
ofthe multimedia devices 142 - 146 preferably includes the interface logic 170, as shown in Figure 2. 

The multimedia devices 142 - 146 preferably use the multimedia or real-time bus 130 only for high speed 
data transfers of real-time stream data information, in one embodiment the multimedia bus 130 transfers onlv 
periodic stream data, i.e.. data streams which require periodic transfers for multimedia or communication 
purposes. Examples of periodic data include audio data, which is typically transmined at 44,100 samples per 
second, video data, which is typically transmined at 30 frames per second, or real-time communication streams 
at rates dependent on the transport media. In an alternate embodiment, the multimedia bus 1 30 is used for any 
of various types of multimedia or communications data transfers, including both periodic and aperiodic data. 

In the embodiment shown in Figure 1, the multimedia bus 1 30 includes primarily or only data lines, such 
as a 32 bit or 64 bit data path, and does not include address or arbitration portions. As discussed above with 
reference to Figure 2, the multimedia devices 1 42 - 1 46 each include inieri-ace logic 1 70 which includes PCI 
interface logic 172 and which also includes multimedia bus interface logic 174. In one embodiment of the 
invention, the interface logic 170 in each of the multimedia devices 1 42 - 1 46 uses the PCI bus 120 for addressing 
and control fortransfers on the multimedia bus 130. Tlius the multimedia devices 142 - 146 use the multimedia or 
real-time bus 1 30 only for high speed data transfers. Thus, in this embodiment, the multimedia bus interface logic 
174 includes only data signal pins for interfacing to the data lines comprising the multimedia bus 130. 
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Figure 3A - Flowchart Diagram 

Referring now to Figure 3 A, a flowchart diagram illustrating operation of a multimedia data transfer 
according to this embodiment of the present invention is shown. When a multimedia device such as device 142 
desires to perform a transfer, in step 302 the PCI interface logic 172 in the transferring device transfers control 
information on the PCI bus 120 to set up the transfer. This involves providing an address indicating the 
destination address of the transfer as well as control and status information regarding the length of the transfer, 
among other status information. The transferring device provides the control information to the respective 
destination device. 

Thus the transferring device essentially acts as a PCI bus master in setting up the muUimedia transfer. 
The transferring device also preferably provides a special multimedia transfer flag or data byte to the receiving 
device which informs the receiving device that the upcoming transfer is not a PCI bus transfer, but rather is a 
multimedia bus n-ansfer. it is noted that the transferring device may first be required to arbitrate for control of 
the PCI bus 120. Once the n-ansfer has been set up on the PCI bus 120 in step 302, then in step 304 the 
transferring device performs the data transfer on the multimedia bus 1 30 to the receiving or target device. Also, 
once the transfer has been set up on the PCI bus 120 in step 302, then the PCI bus 1 20 is free for other types of 
transfers. 

Alternatively, the CPU 102 initiates the transfer by providing transfer information to the chipset 106. 
The chipset 106 then either directs the n-ansfer or provides the n-ansfer information to the save and distonion 
devices. 



Figure 3B - PCI/Multimedia Bus Transfer 

Referring now to Figure 3B, in one embodiment the transferring device may also provide a high 
bandwidth PCI / multimedia n-ansfer flag or data byte to the receiving device which informs the receiving 
device that the upcoming transfer will occupy the data lines of both the PCI bus and the multimedia bus 
simultaneously. This type of transfer is preferably reserved for very high bandwidth transfers, such as full- 
screen, full motion video at 30 frames per second. 

As shown, when a multimedia device such as device 142 desires to perform a n-ansfer using both the 
PCI bus data lines and the multimedia bus data lines simultaneously, in step 312 the PCI interface logic 172 in 
the transferring device transfers control information on the PCI bus 120 to the respective destination device to 
set up the n-ansfer. This involves providing an address indicating the destination address of the n-ansfer as well 
as conn-oi and status information regarding the length of the n^sfer, among other status information. 

In step 3 14 the transferring device provides a high bandwidth n-ansfer flag ori the PCI bus (20 to the 
respective destination device indicating that a dual bus transfer is desired. In other words, the high bandwidth 
PCI / multimedia tt^sfer flag indicates that the upcoming n-ansfer will occupy the data lines of both the PCI 
bus 120 and the multimedia bus 130. In step 3 16 the transferring device performs the data n-ansfer on the data 
lines of both the PCI bus 120 and the multimedia bus 130, The n-ansferring device preferably provides separate 
data blocks on each bus's data lines to allow the target device to properly collate the data. 
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Figure 3C - Periodic Data Transfers 

Referring now to Figure 3C. a flowchan diagram illustrating a data transfer method optimized for 
periodic n-ansfers is shown. This method minimizes the amoum of addressing and conn-ol information required 
5 to be transferred by essentially using preset periodic burst transfers for the periodic data. In this disclosure, the 
term 'periodic data" refers to data sn-eams which require transfers with a known periodicity and are typical of 
multimedia or communication processes. Examples of periodic data include audio data, which is typically 
transmitted at 44,100 samples per second, video data, which is typically transmitted at 30 frames per second or 
real-time communication streams at rates dependent on the transport media. Periodic data can be buffered and 

10 transmitted in a burst, but the burst still has a known periodicity, e g, where 100 audio samples are stored before 
a burst n-ansfer, this results in a burst rate of 441 transfers per second. 

As shown, if a multimedia device such as device 142 desires to n-ansfer periodic data streams on the 
multimedia bus 130, in step 322 the PCI interface logic 172 in the multimedia device 142 first transfers control 
information on the PCI bus 120 to the receiving or target device. As noted above, the conn-ol information 

) 5 comprises a destination address of the transfer, information regarding the length of the n-ansfer and other status 
information. 

In step 324 the transferring device provides a periodic data transfer request to the receiving device or 
target device. This periodic data transfer request comprises a request for the multimedia device acting as the 
transmitter to periodically transfer a data stream to the receiving device at a predetermined frequency without 
20 requiring each individual transfer to be .<;ct up with control and addressing infomiation. This periodic data 

request is used for periodic data, such as audio data, which is periodically transferred corresponding to an audio 
sampling rate typically of 44, iOO samples per second, or for motion video transfers, which require a frame 
buffer transfer of 30 frames per second. 

The periodic n-ansfer request includes periodicity data indicating the period or frequency at which the 
25 device 142 is required to transfer the data, i.e., the frequency at which the device will be transferring the data. , 
The periodic data transfer request also includes information regarding the approximate amount of data involved 
in the periodic transfers as well as any real-time consn-aint infomiation. 

In response to the n-ansferring device transferring the periodic n*ansfer request in step 324, the 
receiving device uses the received information to detenmine if it can guarantee availability at the requested lime 
frequency to receive the data. If the receiving device can guarantee availability for receiving this periodic data, 
then the receiving device preferably performs a handshake to indicate that the periodic data transfers can be 
performed. The receiving device also preferably configures one or more timers or counters at the specified 
frequency to indicate when the receiving device should enable its buffers and n-ansceivers to receive the 
periodic dau on the bus. 

In step 326. the transmitting multimedia device determines if the receiving device has indicated 
availability for the periodic transfer. Thus, when the receiving device receives the periodic data transfer request 
in step 324, the receiving device determines if the receiving device can guarantee a certain bandwidth and 
availability at the designated time indicated by the periodic data transfer request. If the receiving device cannot 
guarantee availability at the frequency or period specified by the periodic data transfer request, then the 
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receiving device indicates that it is not available for periodic data transfers. In this case, in step 332 the 
transmitting multimedia device sets the periodic transfer flag to no and in step 334 performs a single transfer. 
In this instance, each future transfer of the periodic data requires that step 322 be performed to transfer conn-ol 
and addressing information to the receiving device to set up the transfer. 

If the receiving device indicates availability for the periodic data transfer in step 326, then in step 338 
the transmitting multimedia device sets the periodic transfer flag to yes and in step 340 the transferring device 
begins the first of a plurality of periodic transfers at the frequency or period specified in the periodic data 
transfer request in step 324. If the multimedia device 142 has indicated a desire to transfer periodic data streams 
on the multimedia bus 130, and the receiving device has indicated availability to perform the transfers, then 
multimedia device 142 performs periodic transfers of data streams to the receiving device. In this instance, the 
receiving device has indicated that it can guarantee availability at the times required by the transmining device. 
Thus the receiving is available to receive each transfer of periodic data. 

Figure 4 ■ Motherboard 

! 5 Referring now to Figure 4, a block diagram of motherboard 200 of the computer system of Figure I is 

shown. As shown, the various devices and buses are preferably comprised on the motherboard 200. The 
motherboard 200 comprises the CPU 102, the chipset logic 106, the main memory 1 10, the PCI bus 120, and the 
real-time or multimedia bus 130. 

The motherboard 200 also includes a plurality of PCI bus connector slots 122 which are electrically 

20 connected to the PCI bus 120. The connector slots 122 are adapted for receiving a corresponding or mating edge 
connector of an expansion card that is adapted for insertion into the PCI connector slots 122. The motherboard 200 
also includes one or more multimedia bus connector slots 1 32 which are adapted to receive corresponding or 
mating edge connectors of expansion cards. 

As shown, each of the multimedia bus connector slots 1 32 corresponds to a respective one of at least a 

25 subset of the PC! bus connector slots 122. In one embodiment, the motherboard 200 includes a first plurality of 
PCI bus connector slots 122 and a second lesser plurality of multimedia bus connector slots 132. In another 
embodiment, multimedia devices interconnected to both the PCI bus and the multimedia bus are implemented 
directly on the motherboard or on a separate daughter card. 

30 Figure 5 - Expansion Card 

Referring now to Figure 5, an expansion card or add-in card 400 is shown, which comprises one of the 
multimedia devices 142-146. Therefore, in one embodiment, one or more of the multimedia devices 142-146 are 
comprised on modular expansion cards adapted for insertion into respective slots of each of the real-time bus 130 
and PCI bus 120, 

35 As shown, a PCI expansion card 400 according to the present invention includes a PCI bus connector 402 

which is adapted for insertion into a PCI expansion bus connector slot 122 for electrically coupling to the PCI bus 
1 20. The adapter card 400 also includes a real-time or multimedia bus connector 404 according to the present 
invention, which is adapted for insertion into connector slot 132 of the real-time bus 130. 
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Thus, one or more of the muhimedia devices 142-146 may be comprised on a modular expansion card 
400 including PCI bus connector 402 and multimedia bus connector 404. Tliis configuration alIow.s for more 
modular and upgradeable expansion options in the computer system. This also provides the benefits of a PCI local 
expansion bus coupled with a real-time or multimedia bus 130 for additional data bandwidth and multimedia real- 
time data transfer capabilities. 

The multimedia device modular expansion card 400 is also backwards compatible with existing PCI 
multimedia devices. For example, existing prior art multimedia devices include PC! bus connector 402 but do not 
include a real-time bus connector 404. These prior an multimedia devices are simply inserted into a respective PCI 
expansion slot 122, and the corresponding real-time connector slot 132 is not used for that respective PCI 
expansion slot 122. Thus, the computer system motherboard 200 shown in Figure 4 may receive prior art 
muhimedia devices or may receive new expansion cards 400 according to the present invention which include both 
a PCI bus connector 402 and real-time bus connector 404. 

Figure 6 - Alternate Embodiment 

Referring now to Figure 6, an alternate embodiment of the computer system of Figure I is shown. In the 
embodiment of Figure 6, chipset logic 106 A is connected to both the local expansion bus 120 as well as real-time 
bus 130A. In this embodiment, the multimedia bus 130A may be different from the muhimedia- bus 130 shown in 
Figure 1 to accommodate CPU accesses through the chipset logic 106A to the real-time bus I30A. and also to 
accommodate peripheral device accesses through the real-time bus I30A and chipset logic i06A to main memory 
1 10. Also, multimedia devices 142 - 146 which are coupled to the PCI bus 120 and the real-time bus 130A in 
Figure 6 may be different from the multimedia devices 142 - 146 in Figure I to accommodate accesses through the 
real-time bus I30A to main memory 110. 

Thus, in this embodiment, the chipset logic I06A can communicate directly to the PCI bus 120, and can 
also communicate directly with the real-time or multimedia bus 130. This facilitates operation of the CPU 102 
communicating with the multimedia devices 142 - 146 through both the PCI bus 120 and the muhimedia bus 130A. 
in addition, one or more of the multimedia devices 142-146 can use the multimedia bus I30A to interface through 
the chipset logic 106 A to the main memory 1 10 as desired. 

Figure 7 - Computer System with Multimedia Bus and Separate Control Channel 

Referring now to Figure 7, a computer system is shown which includes a multimedia bus 1 30 and a 
separate control channel 502. The computer system of Figure 7 is similar to the computer system of Figure I . 
However, the computer system of Figure 7 includes a separate control channel 502 in addition to the PCI bus 120 
and the real-time or multimedia bus 1 30. As described below, multimedia devices use the multimedia bus 1 30 for 
high speed data transfers and use the dedicated control channel for addressing and conffol for the multimedia bus 
transfers. In the following description, elements which are preferably identical to elements previously described 
include the same reference numerals for convenience. 

As shown, the computer system includes a central processing unit (CPU) 102 which is coupled through a 
CPU local bus 104 to a hosl/PCl/cache bridge or chipset 106. The chipset 106 includes various bridge logic, 
peripheral logic and arbitration logic 107, as described above with reference to Figure 1 . The bridge or chipset 106 
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couples through a memory bus 108 to main memory 110. The main memory 1 10 Is preferably DRAM (dynamic 
random access memory) or EDO (extended data out) memor>% or other t>pes of memory, as desired. The chipset 
logic 106 preferably includes a memory controller for interfacing to the main memory 1 10. 

The host/PCI/cache bridge or chipset 106 interfaces to a local expansion bus or system bus 120, In the 
5 preferred embodiment, the local expansion bus 120 is the peripheral component interconnect (PCI) bus 120. 
However, it is noted that other local buses may be used, such as the VESA (Video Electronics Standards 
Association) VL bus. Various types of devices may be connected to the PCI bus 120. Expansion bus bridge logic 
150 and an expansion bus 152 may also be coupled to the PCI bus 120, as described above. 

The computer system shown in Figure 7 includes a real-time bus. also referred to as a multimedia bus 1 30. 
!0 The multimedia bus 130 preferably includes a 32 or 64 bit data path and in this embodiment does not include 

address and control portions. The computer system shown in Figure 7 further includes a dedicated conu-ol channel 
502 separate from the PCI bus 120 and the multimedia bus 130 for transferring control information for 
multimedia bus data transfers. The control channel 502 is preferably a serial bus such as the Philips i2C serial 
bus from Philips Corp. Alternatively, the control channel 502 is a 4.bit or 8-bit bus. Thus a multimedia data 
1 5 transfer initially involves the transfer of control information on the dedicated control channel 502 followed by 
the transfer of data streams, preferably periodic data streams, on the multimedia bus 130. Alternatively, the 
control channel 502 may be integrated into the multimedia bus 130 as addressing, control and status lines. The 
control channel 502 may be used to transfer interrupt, synchronization, and status commands and information. 
One or more multimedia devices I42A, I44A, and 1 46A are coupled to each of the PCI bus 120 and the 
20 multimedia bus 130. The multimedia devices I42A-I46A each include bus interface circuin>' 5 12 which includes 
standard PCI interface circuitry for communicating on the PCI bus 120. interface logic for interfacing to the 
multimedia bus 130, and control channel interface logic for interfacing to the control channel 502. The multimedia 
devices I42A - 146A use the multimedia bus 130 to communicate data between the respective devices and use the 
conn-ol channel 502 for addressing and control of the multimedia bus 130. 

multimedia devices I42A.I46A may be any of various types of input/output devices, including 
multimedia devices and communication devices, as described above. The multimedia devices 142A-146A arc 
preferably similar to the multimedia devices 142 -146 described above, except that the interface logic 5 12 in the 
multimedia devices I42A-146A each include control channel interface logic, as described below. As described 
above, the multimedia devices 142A - 1 46 A may comprise video accelerator or graphics accelerator cards, video 
30 playback cards. NfPEG decoder cards, sound cards, network interface cards, SCSI adapters for interfacing to 
various input/output devices, such as CD-ROMS and tape drives, or other devices as desired. 

Thus, the multimedia devices I42A - I46A communicate with each other via the PCI bus 120 and also 
communicate with the CPU 102 and main memory 1 10 via the PCI bus 120, as is well known in the art. The 
multimedia devices I42A - I46A also communicate data between each other using the real-time bus or multimedia 
35 bus 130. When the multimedia devices I42A - 146A communicate using the real-time bus 130. the devices use the 
control channel 502 for addressing, control, status and handshaking signals. Thus the devices I42A - I46A do not 
utilize any PCI bus cycles when communicating over the multimedia bus 130. 

In the embodiment of Figure 7, arbitration logic 504 is coupled to the control channel 502 and perfomis 
arbitration for the devices I42A - 146A on the bus 130. Alternatively, arbitration logic 504 is incorporated into the 
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PCI Bridge Chipset 106. In these embodiments. Die multimedia devices 1 42 A - 146A provide request signals on 
the control channel 502 to the arbitration logic 504. and the arbitration logic 504 grants bus access according to a 
desired arbitration method. 

Multimedia devices 

Referring now to Figure 8, a block diagram is shown illustrating one of the multimedia devices 142 A - 
I46A. such as multimedia device 142A. As shown, the multimedia device I42A includes interface logic 512 
comprising PC! interface circuitry 522 for communicating on the PCI bus 120, multimedia bus interface logic 524 
for interfacing to the multimedia bus 130, and also including control channel interface logic 526 for interfacing to 
the control channel 502. The multimedia device I42A also may include a digital signal processor (DSP) 210 or 
other hardware circuitry for implementing a multimedia or communications flinction. Each of the multimedia 
devices 142A - I46A preferably includes the interface logic 5 12, as shown in Figure 8. 

The multimedia devices 1 42 A - 146A preferably use the multimedia or real-time bus 130 only for high 
speed data transfers of real-time stream data information. In one embodiment the multimedia bus 130 n-ansfers 
only periodic stream data, i.e.. data streams which require periodic transfers tor multimedia or communication 
purposes, as described above. Examples of periodic data include audio data, which is typically transmined at 
44,100 samples per second, video data, which is typically transmined at 30 frames per second, or real-time 
communication streams at rates dependent on the transport media. In an alternate embodiment, the multimedia 
bus 130 is used for any of various types of multimedia or communications data transfers, including both 
periodic and aperiodic data. 

In the embodiment shown in Figure 7, the multimedia bus 130 includes primarily data lines, such as a 32 
bit or 64 bit data path, and does not include address or arbitration ponions. In this embodiment of the iovention, 
each of the multimedia devices 142A - I46A uses the control channel 502 for addressing and control for n-ansfers 
on the multimedia bus 130. Thus the multimedia devices I42A - I46A use the multimedia or real-time bus 130 
only for high speed data transfers. Thus, in this embodiment, the multimedia bus interface logic 524 includes only 
data signal pins for interfacing to the data lines comprising the multimedia bus 1 30. Also, PCI bus bandwidth is 
not affected by multimedia bus transfers. 

Figure 9A - Flowchart Diagram 

Referring now to Figure 9A, a flowchan diagram is shown illustrating operation of a multimedia data 
transfer according to the embodiment of Figure 7. When a multimedia device 1 42 A desires to perform a 
n-ansfer, in step 542 the control channel interface logic 526 in the transferring device transfers conn-ol information 
on the control channel 502 to set up the transfer. This involves providing an address indicating the destination 
address of the transfer as well as control and status information regarding the length of the n-ansfer, among other 
stanis information. The transferring device provides the control information to the respective destination 
device. 

Once the transfer has been set up on the control channel 502 in step 542, then in step 544 the 
n-ansferring device performs the data transfer on the multimedia bus 130 to the receiving or target device. 
During the entire transfer in steps 542 and 544, the PCI bus 120 is free for other types of n-ansfers. 
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Figure 9B - Periodic Data Transfers 

Referring now to Figure 9B, a nowchart diagram illustrating a data transfer method optimized for 
periodic transfers is shown. This method minimizes the amount of addressing and control handshaking and 
increases performance as described above by essentially using preset periodic burst transfers for the periodic 
data. In this disclosure, the term ^'periodic data" refers to data streams which require transfers with a known 
periodicity and are typical of multimedia or communication processes. Examples of periodic data include audio 
data, which is typically transmitted at 44.100 samples per second, video data, which is typically transmined at 
30 frames per second, or real-time communication streams at rates dependent on the transport media. 

As shown, if the multimedia device 1 42 A desires to transfer periodic data streams on the multimedia 
bus 130, in step 552 the control channel interface logic 526 in the multimedia device 142 first transfers control 
information on the control channel 502 to the arbitration logic 504. The control information preferably 
comprises arbitration information used by the arbin-ation logic 504 in determining who should receive control of 
ihe multimedia bus 130. the control information also includes a destination address of the transfer, information 
1 5 regarding the length of the transfer and other status information. 

Once the requesting device has received control of the bus 130. in step 554 the transferring device 
provides a periodic data transfer request to the target device. This periodic data n-ansfcr request may be 
transferred over the conn-ol channel 502 or the multimedia bus 130. As described above, the periodic data 
transfer request comprises a request for the multimedia device acting as the transminer to periodically transfer a 
20 data stream to the receiving device at a predetermined frequency without requiring each individual transfer to be 
set up with conn-ol and addressing information. This periodic data request is used for periodic data. 

The periodic n-ansfer request includes periodicity data indicating the period or frequency at which the 
transferring device is required to transfer the dau. i.e.. the frequency at which the device will be transferring the 
data. The periodic data transfer request also includes information regarding the approximate amount of data 
25 involved in the periodic transfers as well as any real-time consn-ainl information. 

in response to the n^ansferring device transferring the periodic transfer request in step 554, the 
receiving device uses the received information to determine if it can guarantee availability at the requested time 
frequency to receive the data. If the receiving device can guarantee availability for receiving this periodic data, 
then the receiving device preferably performs a handshake to indicate that the periodic data transfers can be 
30 perfomied. The receiving device also preferably configures one or more timers or counters at the specified 
frequency to indicate when the receiving device should enable its buffers and transceivers to receive the 
periodic data on the bus 130. 

In step 556, the transmitting multimedia device determines if the receiving device has indicated 
availability for the periodic transfer. Thus, when the receiving device receives the periodic data transfer request 
35 in step 554, the receiving device determines if the receiving device can guarantee a certain bandwidth and 

availability at the designated time indicated by the periodic data transfer request. If the receiving device cannot 
guarantee availability at the frequency or period specified by the periodic data transfer request, then the 
receiving device indicates that it is not available for periodic data transfers. In this case, in step 562 the 
transmining multimedia device sets the periodic transfer flag to no and in step 564 performs a single transfer. 
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[n this instance, each future transfer of the periodic data requires thai step 552 be performed to transfer control 
and addressing information to the receiving device to set up the transfer. 

If the receiving device indicates availability for the periodic data transfer in step 556, then in step 558 
the n-ansmining multimedia device sets the periodic uansfer flag to yes and in step 560 the transferring device 
begins the Hrst of a plurality of periodic transfers at the frequency or period specified in the periodic data 
transfer request in step 554. If the n-ansferring device has indicated a desire to transfer periodic data streams on 
the multimedia bus 130, and the receiving device has indicated availability to perform the transfers, then the 
transferring device performs periodic transfers of data sn-eams to the receiving device. In this instance, the 
receiving device has indicated that it can guarantee availability at the times required by the transmitting device. 
Thus the receiving is available to receive each transfer of periodic data. 

Figure 10 - Multimedia Channels 

Referring now to Figure 1 0, a computer system is shown which includes a plurality of individual 
multimedia channels for two or more of video data, audio data, and communication data. The computer system of 
Figure 10 is similar to the computer systems of Figures 1 and 7. However, the computer system of Figure 10 does 
not include a single general purpose multimedia bus, but rather includes separate video, audio, and communications 
channels 602 - 606. These separate channels 602-606 may be in addition to the PCI bus 120. or may replace the 
PCI bus 120. in the following description, elements which are preferably identical to elements previously 
described include the same reference numerals for convenience. 

As shown, the computer system includes a central processing unit (CPU) 102 which is coupled through a 
CPU local bus 104 to a host/PCI/cache bridge or chipset 106. The chipset 106 includes various bridge logic, ^' 
peripheral logic and arbitration logic 107, as described above with reference to Figure I. The bridge or chipset 106 
couples through a memory bus 108 to main memory 110. The main memory 1 10 is preferably DRAM (dynamic 
random access memory) or EDO (extended data out) memory, or other types of memory, as desired. The chipset 
logic 1 06 preferably includes a memory controller for interfacing to the main memory 1 1 0. 

The host/PCI/cache bridge or chipset 106 interfaces to a local expansion bus or system bus 120. in the 
preferred embodimem, the local expansion bus 120 is the peripheral component interconnect (PCI) bus 120. 
However, it is noted that other local buses may be used. Various types of devices may be connected to the PCI bus 
120. Expansion bus bridge logic 150 and an expansion bus 152 may also be coupled to the PCI bus 120. as 
described above. 

The computer system shown in Figure 10 includes a plurality of real-time data channels, including a video 
channel 602, an audio channel 604, and a communications channel 606. In the preferred embodiment, the video 
data channel 602 is used for transferring video and/or graphics information, the audio channel 604 is used for 
n-ansferring audio information, and the optional third channel 606 is for transferring communications 
information. The video channel is preferably 32 bits, 24 bits, 16 bits, or a high speed serial channel. The audio 
channel is preferably 16 bits or 8 bits. Alternatively, the audio channel is a very high speed serial bus. The 
communications channel is also preferably either 16 or 8 bits, or a high speed serial bus. Alternatively, the 
system shown in Figure 10 may include a mixture of dedicated (i.e. video only) and shared (i.e. audio and 
communications) channels. The video, audio and communication channels are preferably physically and 
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electrically separate channels. The video, audio, and communication channels may each have individual 
addressing and control portions or may use the addressing and conn-ol ponions of the expansion bus 120. 

One or more muhimedia devices or multimedia devices I42B. I44B. and I46B are coupled to each of the 
PCI bus 120 and to each of the data channels 602 - 606. TTie muhimedia devices I42B - 146B preferably multiplex 
data onto the respective channels for reduced pinout requirements. The multimedia devices 1 42B - 1 46B each 
include bus interface circuitry 612 which includes standard PCI interface circuitry for communicating on the PCI 
bus 120. and interface logic for interfacing to each of the channels 602 - 606. The multimedia devices I42B - 
I46B use the respective chamiels 602 - 606 to communicate data of the respective data type between the respective 
devices. 

As described above, the multimedia devices I42B - I46B may be any of various types of input/output 
devices, including multimedia devices and communication devices, as described above. The multimedia devices 
I42B . I46B are preferably similar to the multimedia devices 142 - 146 described above, e.xcept that the interface 
logic 612 in each of the multimedia devices 142B - 1 46B includes channel interlace logic for each data channel 
602 - 606. As described above, the multimedia devices I42B - I46B may comprise video accelerator or graphics 
accelerator cards, video playback cards. MPEG decoder cards, sound cards, network interlace cards. SCSI adapters 
for interfacing to various inpul/output devices, such as CD-ROMS and tape drives, or other devices as desired. 

Thus, the multimedia devices 142B - I46B communicate with each other via the PCI bus 120 and also 
communicate with the CPU 102 and main memory 1 10 via the PCI bus 120, as is well known in the art. The 
multimedia devices 142B - 146B also communicate data between each other using the data channels 602 - 606. 

The multimedia devices I42B - I46B use each of these channels 602 - 606 for high speed data transfers. 
The multimedia devices 142B - I46B use either the PCI bus 120 or a dedicated control channel (not shown) for 
addressing and control for transfers on one or more of the data channels 602 - 606. 

In one embodiment of the system of Figure 10 which includes a control channel (not shown), as described 
above with reference to Figure 7. arbitration logic 614 is coupled to each of the data channels 602 - 606 and the 
control channel and performs arbitration for the devices I42B - I46B on the channels 602 - 606. In this 
embodiment, the multimedia devices 142B - 146B provide request signals on the control channel to the arbitration 
logic 614, and the arbitration logic 6 1 4 grants channel access according to a desired arbitration method. 

Figure 1 1 - Multimedia Bus Interface with Timeslotting Logic 

Referring again to Figures 1 and 7, in one embodimem the multimedia bus 130 is time sliced wherein 
time slices or time slots are allocated in proportion to the required bandwidth. In this embodiment, the 
multimedia devices, such as the multimedia devices 142 shown in Figure 2 or I42A shown in Figure 8 include 
time slotting logic. Referring now to Figure 1 1, logic components of a multimedia bus interface 174 comprised 
in the multimedia devices in this embodiment are shown. Multimedia bus interface logic 1 74 A shown in Figure 
1 1 is preferably comprised in each of the multimedia devices comprised in the computer system, such as the 
multimedia devices 142-146 shown in Figure 1 or the multimedia devices I42A-I46A shown in Figure 7. As 
shown, each multimedia bus interface 174A in the device includes bus transceivers and buffers 642 for 
interfacing to the respective multimedia bus 1 30. 
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The muhimedia bus interface 174A also includes timesioiting logic 644 for controlling access of the 
respective multimedia device to the multimedia bus 130. The timesloning logic 644 preferably uses one or 
more timers and counters 646 for determining respective timeslot. The multimedia bus interface logic 1 74A 
also includes programmable timeslot registers which are programmed by a central agent, such as the CPU 102. 
5 with the respective timeslot position and length on the multimedia bus. In one embodiment, the CPU 102 
programs a timeslot into each of the multimedia devices at startup or boot time, thus providine a static 
allocation of timcslots. Alternatively, software executing on the CPU 102 dynamically programs limeslots in 
each of the multimedia devices dependent upon reai-time processes and applications occurring in the computer 
system. The timeslotting logic 644 preferably includes synchronization logic which operates in conjunction 

10 with the timers and counters 646 and the programmable timeslot registers 648 storing the respective timeslot 
allocated to the respective device. The multimedia bus interface logic 1 74A further includes multimedia bus 
monitoring logic 650 for monitoring conditions on the bus and includes collision detection logic 652 for 
determining when a bus transfer from the respective multimedia device has inadvertently collided with another 
devices transfer. The multimedia bus monitoring logic 650 preferably insures that the multimedia bus 130 is 

1 5 inactive and has been inactive for a preset period of time before the timeslotting logic 644 allows the data 
transfer to begin. 

In one embodiment, as shown in Figure 12A, the time slices are each a constant size and a number of 
the equal sized time slots are allocated to respective data streams in proponion to the required band width. In 
this embodiment, for example, video data streams may be allocated more time slots than audio data sn-eams 

20 because of the increased data transfer band width requirements of video streams. Alternatively, as shown in 

Figure I2B. the time slots are not equally sized, but rather are dynamically sized or allocated to data streams in 
proportion to the required bandwidth and may be reprogrammable as conditions within the system change. 

In this embodiment, multimedia devices that connect to the multimedia bus include intelligent 
conn-ollcr circuitry which includes knowledge of the respective time slice allocated to the multimedia device. In 

25 this embodiment, arbitration for the multimedia bus is not required. Rather, a multimedia device programmed 
as a transminer of video data monitors the bus and includes conn-oller circuitry which begins transmittmg the 
video data when the device's respective time slot occurs. A corresponding device programmed as a receiver of 
said data also knows that the current time slot is a video time slot and monitors the bus to receive the data. 

In this embodiment, the interface circuitry of each of the multimedia devices are programmed at boot 

30 time for a static allocation of time slots. Alternatively, the interface circuitry in the multimedia devices is 
dynamically programmed by a central controller dependent upon the mix of real-time processes and 
applications and the corresponding data transfer bandwidth requirements. For example, the CPU may program 
each of the multimedia devices with a respective time slot at power-on. Alternatively, if the mix of real-time 
processes change, the CPU may dynamically or heuristically allocate time slots based on bandwidth 

35 requirements. 



Figure 13 - Centralized I/O Processor 

Referring now to Figure 1 3, an alternate embodiment of the computer system of Figure I is shown. 
This computer system shown in Figure 13 is preferably similar or identical to the system shown in Figure I 
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except that the system shown in Figure 13 includes a dedicated multimedia I/O processor 702 coupled to the 
multimedia bus 130 which controls operations on the multimedia bus 130. The I/O Processor 702 is preferably 
implemented within the PCI Bridge Chipset 106, but may ahemativeiy be implemented external to the chipset 
as shown in Figure 13. 

In this embodiment of the invention, the centralized multimedia I/O processor operates to direct or 
"pull" data stream information through the system. The multimedia I/O processor 702 is programmed with 
knowledge of the various data rates, data periodicity, data sources and destinations, and coordinates all transfers 
within the system. Thus, the multimedia I/O processor 702 creates connections between two or more devices, 
sets up transfers between devices, and (optionally) executes the transfer. The cenn-alized multimedia I/O 
processor 702 of the present invemion may be used exclusively in the multimedia bus 130 or may be used on a 
standard PCI bus 120. Alternatively, the centralized multimedia I/O processor 702 may couple to both the 
expansion bus 120 and the multimedia bus 130 and control operations on both buses. 

Referring now to Figure 14, a block diagram illustrating the multimedia I/O controller 702 shown m 
Figure 13 is shown. As shown, the multimedia I/O processor includes a plurality of data bus registers and/or a 
15 data bus memory which stores information regarding the data rates of each the devices, the data periodicity of 
each of the devices, and the respective data sources and destination devices comprised in the system. The 
multimedia I/O device 702 also includes data n-ansfer control logic 7 1 4 which is coupled to the data bus 
registers and controls transfers on the multimedia bus 130. The multimedia I/O processor 702 further includes 
byre slicing logic 716. 

20 

Byte Slicing 

In one embodiment, the cenn-alized multimedia I/O processor 702 byte slices the multimedia bus 130 
and/or the expansion bus 120 to allow different data streams to use different byte channels simultaneously. In 
this embodimem, the multimedia bus 130 includes a plurality of data channels, preferably data byte lanes or 

25 channels, which may be used by different multimedia devices concurrently. Thus, a first data stream is 

transferred on a first one or more data byte channels substantially concurrently with a second data stream being 
transferred on a second one or more data byte channels. Thus, where a first multimedia device 142 generates a 
first data stream and a second multimedia device 144 generates a second data stream, the byte slicing logic 716 
assigns the first data stream to a first one or more data byte channels and assigns the second data stream to a 

30 second one or more data byte channels. In this case, the first multimedia device 142 generates the first data 

stream on the first one or more data byte channels substantially concurrently with the second multimedia device 
144 generating the second data stream on the second one or more data byte channels. 

Thus the byte sliced multimedia bus allows different peripherals to share the bus simultaneously. The 
byte slicing logic 716 in the centralized multimedia I/O processor 702 thus may assign one data stream to a 

35 subset of the total byte lanes on the multimedia bus 130, and fill the unused byte lanes with another data stream. 
For example, with a 32.bit multimedia bus, if an audio data stream is only 16 bits wide and thus only uses half 
of the multimedia data bus 130 , the multimedia I/O processor 702 intelligently allows data sn^am n-ansfers on 
the unused bits of the multimedia bus 130. 
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In one embodiment, the centralized multimedia I/O processor 702 preferably includes knowledge of 
the destinations and allows transfers to occur without addressing information. In this embodiment, the 
input/output processor 702 comprises a memory for storing data rate, data periodicity, data source, and data 
destination information for said multimedia devices, and the input/output processor 702 operates to selectively 
5 and dynamically assign data streams on selected ones of the data byte channels comprising the respective 
multimedia bus 130 and/or expansion bus 120 using the data rate, data periodicity, data source, and data 
destination infomiation for said multimedia devices. 

In this embodiment where a plurality of multimedia devices are coupled to the multimedia bus 130 
and/or to the expansion bus 120, and wherein each of the multimedia devices perform operations on the 
10 multimedia bus 130 and/or the expansion bus 120, the byte slicing logic 716 operates to selectively and/or 
dynamically assign data streams on selected ones of the data byte channels comprising the respective bus. 

It is noted that the byte slicing logic 716 may be comprised in the centralized multimedia I/O processor 
702 or may be comprised in the bridge logic 106. Further, the byte slicing logic 716 may byte slice either or 
both of the multimedia bus 130 and/or the expansion bus 1 20. 

Referring now to Figure 14a, the present invention also contemplates a method for transferring data on 
a bus in a computer system using byte slicing techniques. This method presumes a computer system similar to 
that shown in Figure 13. wherein the computer system comprises a multimedia bus 130 and/or an expansion bus 
120 including a plurality of data byte channels for transmining data, and a plurality of multimedia devices are 
coupled to the multimedia bus. wherein each of said muhimedia devices perform operations on said multimedia 
20 bus 130 and/or expansion bus 120. As shown, in step 722. a first multimedia device generates a signal 
indicating a transfer of a first stream of data. In step 724, a second multimedia device generates a signal 
indicating a transfer of a second stream of data. In step 726 the byte slicing logic 716 assigns the first stream of 
data to a first one or more data byte channels of the respective bus, i.e.. either the muhimedia bus 1 30 and/or the 
expansion bus 120. In step 728 the byte slicing logic 716 assigns the second stream of data to a second one or 
more data byte channels of the respective bus, i.e., either the multimedia bus 130 and/or the expansion bus 120. 
It is noted that the first data stream is transferred on the first one or more data bvie channels substantially 
concurrently with the second data sn-eam being transferred on the second one or more data byte channels. 
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Figure 15 - Multimedia Memory Embodiment 

Referring now to Figure 15, a block diagram of the computer system according to an alternate 
embodiment of the present invention and including a multimedia memory 160 is shown. The computer system of 
Figure 15 is similar to the computer system of Figure I. However, the computer system of Figure 15 includes a 
multimedia memory 160 coupled to each of the PCI bus 120 and to the real-time bus 130. In the following 
description, elements which are preferably idemical to elements previously described include the same reference 
3 5 numerals for convenience. 

As shown, the computer system includes a central processing unit (CPU) 1 02 which is coupled through a 
CPU local bus 104 to a host/PCI/cache bridge or chipset 106B. -Hie chipset 1 06B includes arbitration logic I07B 
according to the present invemion. The chipset 1 068 is prtjferably similar to the Triton chipset available from Intel 
Corporation, including cenain arbiter modifications to accommodate the real-time bus 130 and the multimedia 
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memory 160 of the present invention. A second level or L2 cache memory (not shown) may be coupled to a cache 
controller in the chipset, as desired. The bridge or chipset 1 06B couples through a memory bus ! 08 to main 
memory 110. The main memory 1 10 is preferably DRAM (dynamic random access memory) or EDO (extended 
data out) memory, or other types of memory, as desired. 

The chipset logic I06B preferably includes a memory controller for interfacing to the main memory 1 10 
and also includes the arbitration logic 107B. Tlie chipset logic 106B preferably includes a direct memory access 
(DMA) system or engine 1 64 which perfonms various DMA operations. The chipset logic 106B preferably 
includes other various peripherals, as described above with reference to figure 1 

The host/PCl/cache bridge or chipset 106B interfaces to a local expansion bus 120. In the preferred 
embodiment, the local expansion bus 120 is the peripheral component interconnect (PCI) bus 120. However, it is 
noted that other local buses may be used, such as the VESA (Video Electronics Standards Association) VL bus. 
Various types of devices may be connected to the PCI bus 120. 

The computer system shown in Figure 15 also includes a real-time bus. also referred to as a multimedia 
bus 1 30. The real-time bus 130 preferably includes a 32 or 64 bit data path and may also include address and 
control ponions. llie real-time bus 130 may be idemical to either the real-time bus 130 shown in Figure 1 or the 
real-time bus 130A shown in Figure I. Alternatively, the real-time bus 130 includes various address and control 
signals for accessing the multimedia memory 160. 

Multimedia memory 160 is coupled to each of the PCI bus 120 and the real-time bus 130. In the 
embodiment of Figure 1 5. the multimedia memoiy 1 60 is preferably dual ported memory. In this embodiment, a 
first port of the memory 160 couples to the PCI bus 120. The second port of the multimedia memory 160 couples 
to the real-lime bus 130. The multimedia memory 160 preferably comprises high speed dual ported VRAM (video 
random access memory), dual poned DRAM (dynamic random access memory), SRAM (static random access 
memory), or another type of memory as desired. The computer system preferably includes a dual port DRAM 
memory controller 162 for controlling the dual pon memory functions of the multimedia memory 1 60. For more 
information on the operation of a dual port memory controller, please see the Imel 8207 Dual-Port Dynamic RAM 
Controller Data Sheet (Order No. 2 10463-007). available from Intel Corporation, which is hereby incorporated by 
reference. 

In the preferred embodiment, the real-time bus 130 includes only a 32 bit or 64 bit data path and does not 
include address or artaitration portions. In one embodiment, devices use the PCI bus 1 20 for arbitration, addressmg 
and setup, and devices use the multimedia or real-time bus 130 for high speed data transfers between each other 
and also to/from the multimedia memory 160. TTius. in one embodiment, devices use the PCI bus 120 to provide 
addressing and control signals to the multimedia memory 160 and use the multimedia or real-time bus 130 for high 
speed data transfers to and from the multimedia memory 160. 

One or more multimedia devices 142C, I44C.and I46C are coupled to each of the PCI bus 120 and the 
35 real-time bus 130. The multimedia devices I42C - I46C include standard PCI interface circuitry for 

communicating on the PCI bus 120. TTie multimedia devices I42C - 146C also include interfaces to the real-time 
bus 130. The multimedia devices I42C - I46C use the real-time bus 130 to communicate data between the 
respective devices. As described above, one or more of the multimedia devices I42C - 146C may be comprised on 
modular expansion cards adapted for insertion into respective slots of each of the real-time bus 130 and PCI bus 
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120. One or more of the multimedia devices M2C - )46C may be implemented directly on the motherboard or on 
a custom circuit card plugged into the motherboard. 

In one embodiment arbitration logic 151 k coupled to the real-time bus 1 30 and performs arbitration for 
the devices I42C - I46C on the bus 130. In this embodiment, the multimedia devices I42C - I46C provide request 
signals on the real-time bus 130. and the arbitration logic 151 grants bus access according to a desired arbitration 
method. Alternatively, the arbitration logic 151 is not included, and the multimedia devices 142C - I46C use the 
PCI bus arbitration to gain control of the real-lime bus 130. 

The multimedia devices I42C - 146C may be any of various types of input/output devices, including 
multimedia devices and communication devices. For example, the multimedia devices I42C - 1 46C may comprise 
video accelerator or graphics accelerator cards, video playback cards, MPEG decoder cards, sound cards, network 
interface cards, SCSI adapters for interfacing to various input/output devices, such as CD-ROMs and tape drives, or 
other devices as desired. 

Thus, the multimedia devices 142C - I46C communicate with each other via the PCI bus 120 and 
communicate with the CPU and main memory 1 10 via the PCI bus 120, as is well known in the art. The 
15 multimedia devices 142C - 146C also communicate data between each other and the multimedia memory 160 

using the real-time bus or multimedia bus 130. When the multimedia devices 142C - 146C communicate using the 
real-time bus 130, the devices are not required to obtain PCI bus mastership and they do not consume PCI bus 
cycles. In one embodiment, the multimedia devices I42C - 146C communicate with the multimedia memory 160 
using either or both of the real-time bus 130 and the PCI bus 120. 

Expansion bus bridge logic (not shown) may also be coupled to the PCI bus 120. The expansion bus 
bridge logic interfaces to a secondary expansion bus (also not shown). The expansion bus may be any of varying 
types, including the industry standard architecture (ISA) bus, also referred to as the AT bus, the extended industry 
standard architecture (EISA) bus, or the microchannel architecture (MCA) bus. Various devices may be coupled to 
the expansion bus, such as expansion bus memory or a modem (both not shown). 

embodiment of Figure 15, each of the multimedia devices I42C - I46C include PCI intert'ace logic 
for coupling to the PC! bus 120 and also include real-time bus interface logic for interfacing to the real-time bus 
130. Each of the multimedia devices 142C - 146C also include arbin^tion logic for gaining control of the real-time 
bus 130 and further include logic which gains access to the multimedia memory 160. Thus, each of the multimedia 
devices I42C - 146C can gain control of the real-time bus 130 and access the multimedia memory 160 to retrieve 
30 desired code and data. 

In the embodiment of Figure 1 5, the multimedia memory 1 60 is mapped to the main memory address 
space and thus comprises a portion of the main memory address space, as shown in Figure 1 7. Thus the 
multimedia memory 160 is available to store non-multimedia data as needed. In other words, if the main memory 
1 10 becomes full and additional memory is needed, the CPU 102 can store code and data in the multimedia 
35 memory 1 60. Thus, in the embodiment the multimedia memory 1 60 is used for real-time or multimedia data and 
is also used by the CPU 102 as overflow memory space. 

In the embodiment shown in Figure 15, one or more of die multimedia devices 142C- I46C includes at 
least one DSP engine 210 which preferably performs a multimedia or communications function, such as video and 
audio processing f\inctions. In the preferred embodiment, the DSP engine 210 is a general purpose DSP engine 



23 



BNSIXX:iD: <WO 9744740A1> 



PCT/US97/08363 

that is programmable to perform either video or audio processing functions as well as other real-time functions. In 
one embodiment, the DSP engine 210 includes one or more ROMs or RAMs which store microcode or instructions 
corresponding to video and audio processing instructions or commands. When programmed as a graphics 
accelerator, the DSP engine 210 preferably perfonms video and graphics functions such as polygon rendering and 
texture mapping, among others. When programmed as a sound card, the DSP engine 210 preferably perfonns audio 
functions such as MIDI and wavetable synthesis, among others. Hie DSP engine 210 may aiso be programmed to 
perform communication functions, such as ISDN connectivity or modem functionality, as desired. In another 
embodiment, the DSP engine is not a general purpose DSP engine but is instead a device that is optimized for the 
performance of one or more multimedia or communications functions. 

In the embodiment shown in Figure 15, the chipset 106B preferably includes DMA transfer engine 164 
which perfonms data transfers between the main memory 1 10 and the multimedia memory 160. The DMA transfer 
engine 164 preferably transfers data from the main memory 110 to the multimedia memory 160 
contemporaneously with operations performed by the one or more multimedia devices 142C - 146C. In one 
embodiment, the multimedia memory 160 is panitioned into two or more separate address spaces or buffers, and 
the DMA engine 164 transfers data from main memory 1 10 to a first address space or buffer in the multimedia 
memory 160 while one of the multimedia devices I42C - I46C accesses commands and data from the other 
address space or buffer. 

As mentioned above, the main memory HO and the multimedia memory 160 preferably share a common 
address space. Figure 17 illustrates the main memory address space, wherein the multimedia memory 160 
comprises part of the main memory address space. Thus the multimedia memory 160 is available to store non- 
multimedia data as needed. In this embodiment, each of the muhimedia devices 142C - I46C and CPU 102 must 
also arbitrate for access to the multimedia memory 160. The multimedia devices i42C - I46C preferably have 
priority access to the multimedia memory 160. in one embodiment, a multimedia device simply writes one or more 
bits to a register in the arbitration logic I07B in the chipset I06B to gain control of the multimedia memor>' 160, 
and the CPU 1 02 is only granted access to the multimedia memory 1 60 after a certain starvation period. 

Multimedia Memory - Svstem Operation 

Figure 18 is a flowchart diagram illustrating operation of the present invention. In the preferred 
embodimem, the main memory 1 10 stores the operating system and applications software as well as driver 
software, including video drivers and audio drivers. The CPU 102 executes applications software and driver 
software from the main memory 1 10 and generates real-time or multimedia data. In the present disclosure, the term 
^^multimedia data" refers to video or graphical data, audio data, telephony data, and other types of real-time or 
communication data. 

When an application executing on the CPU 102 generates multimedia data, the CPU 102 preferably 
transfers or writes the multimedia data to the main memory M 0 in step 502. The multimedia data includes data and 
may include one or more commands that perform operations on the data. 

In an alternate embodiment, the CPU 1 02 provides the multimedia data directly to the multimedia 
memory 160 through the PCI bus 120, and operation proceeds directly to step 512. In this embodiment, the CPU 
102 provides the multimedia data through the PCI bus 120 directly to the multimedia memory 160, and the 
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multimedia devices I42C - 146C access commands and data from the multimedia memory 160 through the 
multimedia bus 130. 

After the CPU 102 preferably writes the multimedia data to the main memory 110 in step 502, the CPU 
102 then provides a data structure directly to the DMA engine 164 in the chipset logic I06B in step 504. The data 
5 structure comprises location information regarding the multimedia data, including the beginning address of the 
data, the length or number of bytes of the data, as well as other information. Alternatively, the CPU 102 provides 
the data structure to buffers within the DMA engine 164. The data structure may also include high level insmiciions 
or commands regarding the nature or purpose of the data. 

In step 506 the DMA engine 164 prioritizes the data structure with other real-time dau structures that have 
10 already been received. Thus the DMA engine 164 intelligently prioritizes received multimedia dau structures 
based on a desired priority scheme and the available resources. Thus, the video and audio components of a 
multimedia presentation may receive a higher priority than a telephony application that can be performed in the 
background. In an alternate embodiment, the DMA engine 1 64 does not prioritize received data strucau-es or 
commands, but rather merely acts as a slave and executes received data structures in the order they arc received, 
1 5 In step 508 the DMA engine 164 arbitrates for access to the main memory 1 1 0. This involves assening a 

bus request signal to the arbitration logic I07B in the chipset 106B. The DMA engine 164 may also provide a 
priority byte to the arbitration logic I07B which is used by the arbitration logic 107B in determining the arbitration. 
Once the DMA engine 164 achieves access to main memory 1 10, the DMA engine 164 uses the data structure 
received from the CPU 1 02 to access the real-time data from main memory 1 1 0 and store the data in the 
20 multimedia memory 1 60 in step 510. 

In one embodiment, the CPU 102 writes video or audio instrijctions or commands to the main memory 
no in conjunction with the corresponding video and/or audio data. In this embodiment, the CPU 102 writes only 
pointer information to the DMA engine 164 which points to the beginning address in main memory 1 10 where the 
data and commands reside. The pointer information includes the beginning address of the data, the length or 
25 number ofbytesoflhe data, as well as other information. In step 510 the DMA engine 1 64 uses the pointer - 
infonmaiion to retrieve the commands and data from main memory 1 10 into the multimedia memory 160. 

Once real-time or multimedia data and commands have been placed in the multimedia memory 160, cither 
by the CPU 102 or retrieved from main memory 1 10. in step 5 12 one or more of the multimedia devices I42C - 
I46C read the commands and data from the multimedia memory 160 and in step 514 perform the necessary 
30 graphics and audio processing functions. The respective multimedia device 142C - 146C then generates the 

appropriate video and audio signals to the video and audio ports in step 516. In one embodiment, the multimedia 
memory 160 is partitioned into separate address spaces for commands and data, and the multimedia device 
retrieves commands from a first address space and retrieves data from a second address space. 

The CPU 102 preferably writes video and/or audio commands and data to the main memory 1 10 instead 
35 of directly to the muhimedia memory 160 in order to minimize CPU accesses to the multimedia memory 160. This 
ensures that the multimedia devices I42C - I46C have full access to the multimedia memory 160 for real-time 
processing. Further, the multimedia devices I42C - 146C retrieve commands and data from the main memory 1 10 
only when necessary, and the multimedia devices I42C - I46C are not "locked out" of the multimedia memory 160 
due to CPU writes to the multimedia memory 160. 
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In an alternate embodiment, as mentioned above, the CPU 102 writes video and/or audio data and 
commands directly to the multimedia memory 160. In this embodiment, the CPU 102 executes applications 
software and driver software from the main memory II 0 and writes any associated video and audio data directly to 
the multimedia memory 160. The driver software also writes high level commands directly to the multimedia 
memory 160. Thus, the video drivers write high level commands to the multimedia memory 160 in a similar 
manner to current PCI-based graphics acceleration cards. 

In one embodiment, the multimedia memory 160 is separated into two or more address spaces or buffers, 
and the CPU 102 writes to one address space or buffer while the one or more multimedia devices 142C - I46C 
accesses commands and data from the other address space or buffer. This ensures that the multimedia devices 
142C - 146C have unintemipied access to commands and data in the multimedia memory 160 while also allowing 
the CPU 102 to directly write real-time commands and data to the muhimedia memory 160. 

Figure 19 - Hifih Speed Memory Channel Per Peripheral 

Referriiig now to Figure 19. a computer system is shown which includes a PCI or multimedia bus 120 and 
which also includes a separate memory data channel for each peripheral connected to the bus 120, The computer 
system of Figure 1 9 is similar to the computer system of Figure I . However, the computer system of Figure ! 9 
includes a separate memory data channel for each peripheral to the memory controller. As described below, 
multimedia devices use the respective memory data channel 130 for high speed data transfers. In the following 
description, elements which are preferably identical to elements previously described include the same reference 
numerals for convenience. 

As shown, the computer system includes a central processing unit (CPU) 102 which is coupled through a 
CPU local bus 104 to a host/PCI/cache bridge or chipset 106. The chipset 106 includes various bridge logic, 
peripheral logic and arbitration logic 107, as described above with reference to Figure 1 . As shown, the chipset 106 
includes PCI bridge logic 932 and a memory controller 934, The bridge or chipset 1 06 couples through a memory 
bus 108 to main memory 1 10. The main memory 1 10 is preferably DRAM (dynamic random access memotr) or 
EDO (extended data out) memory, or other types of memory, as desired. The memor>' controller 934 in the chipset 
106 interfaces to the main memory 1 10. 

The host/PCI/cache bridge or chipset 106 interi-aces to a local expansion bus or system bus 120. In the 
preferred embodiment, the local expansion bus 120 is the peripheral component interconnect (PCI) bus 120 or 
other type of system bus such as a dedicated multimedia or reai-time bus. Various types of devices may be 
connected to the PCI bus 120. Expansion bus bridge logic I and an expansion bus (both not shown) may also be 
coupled to the PCI bus 120, as described above. 

One or more multimedia devices or multimedia devices 902-9 1 0 are coupled to the PCI bus 1 20. In the 
embodiment shown, a CD-ROM 902, a Video/Graphics card 904, an Audio card 906, a telephony card 908, and an 
MPEG decoder card 9 10 may be coupled to the PCI bus 1 20, Various other types of peripherals may be connected 
to the bus 1 20» as desired. 

Each of the multimedia devices 902 - 910 includes a dedicated memory data channel 912 - 920, 
respectively, which connects to the memory controller 934 in the chipset logic 106. Each of the memory data 
chamiels is preferably a high speed serial bus, such as the Philips l^C serial bus from Philips Corp., or a 4 bit, 8 bit 
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bus, or 16 bit bus. Each of the multimedia devices 902-910 uses its dedicated memory data channel 9 12 - 920 to 
perform data accesses and transfers directly to the main memory i 10. bypassing PCI bus arbitration and PCI bus 
cycles. The dedicated memory channels may also be coupled directly to the main memorv' 1 10 instead of to the 
memory controller 934. 

The multimedia devices 902-910 each include bus interface circuitry 940 which includes standard PCI 
interface circuitry for communicating on the PCI bus 120. The interface circuitry 940 in each of the multimedia 
devices 902- 910 also includes interface logic for interfacing to the respective dedicated memory data channel 912 
- 920. The multimedia devices 902-910 use the PCI bus 120 to communicate data between the respective devices, 
and each uses its respective channel for main memory accesses. 

The multimedia devices 902 - 910 may be any of various types of input/output devices, including 
multimedia devices and communication devices, as described above. The multimedia devices 902 - 910 are 
preferably similar to the multimedia devices 902 - 910 described above, except that the interface logic in the 
multimedia devices 902 - 9 1 0 each include memory data channel interface logic, as described below. As described 
above, the multimedia devices 902 - 910 may comprise video accelerator or graphics accelerator cards, video 
playback cards, MPEG decoder cards, sound cards, network interface cards. SCSI adapters for interfacing to 
various input/output devices, such as CD-ROMS and tape drives, or other devices as desired. 

Thus, the muhimedia devices 902 - 910 communicate with each other via the PCI bus 120 and also 
communicate with the CPU 102 and main memory 1 10 via the PCI bus 120, as is well known in the art. 

The multimedia devices 902 - 910 also each communicate data to and from the main memory 1 10 using 
the device's respective dedicated memory data channel. The multimedia devices 902 -910 preferably each use its 
dedicated memory data channel for addressing, control, status and handshaking signals, as well as for data 
communications. Thus the devices 902 - 910 do not utilize any PCI bus cycles when communicating over their 
respective memory data channel. Alternatively, the multimedia devices 902-910 set up the memory data channel 
transfer using PCI bus cycles and then perform the transfer on the data channel. Thus, in one embodiment, each 
multimedia device uses the PCI bus address and conn-ol signals to set up a date transfer on the respective memory 
data channel as discussed with reference lo Figure 3A. A multimedia device may also use the PCI bus address and 
control signals to set up periodic transfers on the respective memory data channel. Thus, in a similar manner to that 
discussed above with respect to Figure 3d, once the device has set up the periodic transfer, the memory 1 10 
periodically transfers dau to the multimedia devices, or vice versa, at periodic intervals. 

In the embodiment of Figure 19, arbitration logic 936 is comprised in the chipset 106 and/or in the 
memory controller 934 and coupled to the memory controller 934. The arbitration logic 936 receives memory 
requests from each of the devices 902-9 1 0 and perfoms arbitration for the devices 902 - 9 1 0 attempting to access 
the main memory 1 10. In this embodiment, the multimedia devices 902-910 provide request signals on their 
respective channel to the arbitration logic 936, and the arbitration logic 936 grants main memoi^ access according 
to a desired arbitration method. The memory controller 934 also routes data transfers from the main memory 1 1 0 
to the respective memory data channels. 



Figure 20 - Multimedia Devices 
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Refeiring now to Figure 20, a block diagram is shown iilusirating one of the multimedia devices 902 - 
910. such as multimedia device 902. As shown, the multimedia device 902 includes interface logic 940 comprising 
PCI interface circuitry 942 for communicating on the PCI bus 120. and also including memory data channel 
interface logic 944 for interfacing to the respective data channel. The multimedia device 902 also may include a 
digital signal processor (DSP) 210 or other hardware circuitry for implementing a multimedia or communications 
function. Each of the multimedia devices 902 - 910 preferably includes the interface logic 940. as shown in Figure 
20. 

The multimedia devices 902 - 910 preferably use their respective memory data channel only for high 
speed data transfers of real-time stream data information and/or periodic data transfers to or from the main memory 
1 1 0. In an alternate embodiment, the memory data channels are used by each multimedia device for any of 
various types of multimedia or communications data n^nsfers to or from main memory 1 10. 

In one embodiment, each memory data channel includes only data lines, such as an 8 bit or 16 bit data 
path, and docs not include address or control portions. In this embodiment of the invention, as mentioned above, 
each of the multimedia devices 902-910 uses the PCI bus 120 for addressing and control for transfers on the 
respective memory data channel. 

Figure 2 1 - PCI Bus Including a Real-Time Mode 

Referring now to Figure 21. a computer system is shown which includes an expansion bus. preferably a 
PCI bus 120, and which includes mode logic 960 which selects between different modes of the PCI bus 120. The 
computer system of Figure 2 1 is similar to the computer system of Figure 1 . However, the mode logic 960 in the 
computer system of Figure 21 is operable to place the PCI bus 120 in either a normal PCI mode or in a real-time 
/multimedia mode optimized for multimedia transfers of periodic data. As described below, multimedia devices use 
the PCI bus 120 for normal PCI transfers and also use the PCI bus lines In the multimedia mode for high speed data 
multimedia transfers, preferably transfers of periodic multimedia data or transfers which involve byte slicing and/or 
time slotting. In the following description, elements which are preferably identical to elements previously 
described include the same reference numerals for convenience. 

As shown, the computer system includes a central processing unit (CPU) 102 which is coupled through a 
CPU local bus 104 to a host/PC 1/cache bridge or chipset 106. The chipset 106 includes various bridge logic, 
peripheral logic and arbitration logic 107. as described above with reference to Figure 1. The chipset 106 also 
includes mode logic 960 according to the present invention for selectively and dynamically placing the expansion 
bus 120 in either a normal mode or a real time mode according to the present invention. 

The bridge or chipset 106 couples through a memory bus 108 to main memory 1 10. The main memory 
1 10 is preferably DRAM (dynamic random access memory) or EDO (extended data out) memory, or other types of 
memory, as desired. The chipset logic 106 preferably includes a memory controller for interfacing to the main 
memory i 10. 

The host/PCI/cache bridge or chipset 106 interfaces to a local expansion bus or system bus 120. In the 
preferred embodiment, the local expansion bus 120 is the peripheral component interconnect (PCI) bus 120. 
However, it is noted that other local buses may be used, such as the VESA (Video Electronics Standards 
Association) VL bus or "Firewire". Various types of devices may be connected to the PCI bus 120. Expansion bus 
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bridge logic 150 and an expansion bus 152 may also be coupled to the PCI bus 120, as described above. As 
mentioned above, the mode logic 960 is operable to place the PCI bus 120 in either a normal PCI mode or in a real- 
time /multimedia mode optimized for multimedia transfers of periodic data. 

The computer system shown in Figure 21 optionally includes a real-time bus. also referred to as a 
multimedia bus 130 (not shown in Figure 21). The multimedia bus 130 preferably includes a 32 or 64 bit data path 
and may include address and control portions. The computer system shown in Figure 21 may include a dedicated 
control channel, such as that shown in Figure 7, as desired. In the embodiment of Figure 2 1 , the multimedia bus 
130 is optionally provided to augment or supplement the PCI bus 120 when the PCI bus 120 is in multimedia 
mode. 

One or more multimedia devices or multimedia devices I42D. I44D, and 146D are coupled to each of the 
PCI bus 120 and the multimedia bus 130. As shown in Figure 22, the multimedia devices I42D - I46D each 
include bus interface circuitry 962 which includes standard PCI interface circuitry 964 for interfacing to the PCI 
bus 120 when the PCI bus is in a normal PCI mode. The bus interface circuitry 962 also includes interface logic 
966 for interfacing to the PCI bus 120 when the PCI bus 120 is in the multimedia mode. The bus interface circuitry 
962 also includes interface logic 968 for interfacing to the optional multimedia bus 130. 

The multimedia devices I42D - N6D may be any of various types of input/output devices, including 
multimedia devices and communication devices, as described above. The multimedia devices I42D - 146D are 
preferably similar to the multimedia devices 142-146 described above, except that the interface logic 962 in the 
multimedia devices 142D - I46D each include the interface logic for interfacing to the PCI bus 120 in multiple ~ 
modes. As described above, the multimedia devices I42D - I46D may comprise video accelerator or graphics . 
accelerator cards, video playback cards, MPEG decoder cards, sound cards, network interface cards, SCSI adapters 
for interfacing to various input/output devices, such as CD-ROMS and tape drives, or other devices as desired. 

Thus, the multimedia devices I42D- 146D communicate with each other and with the CPU 102 and main 
memory 1 10 via the PCI bus 120, as is well known in the art. The multimedia devices 142D - I46D also 
communicate data between using the PCI bus signal lines 120 when the PCI bus 120 is in the multimedia mode. 
As noted above, the reai-time bus or multimedia bus 130 is optionally used to supplement the PCI bus 120 when 
the PCI bus 120 is in the muhimedia mode. 

In the preferred embodiment of the invemion of Figure 21, the multimedia mode comprises placing the 
system bus or PCI bus 120 in a special mode optimized for real-time data transfers. In one embodiment of 
Figure 2 1, the special mode comprises a byte sliced mode which uses differem byte lanes or channels of the PCI 
data lines for differem types of multimedia transfers as described above. Thus, 16 bits of the PCI bus may be 
used for video transfers while the remaining 16 bits may be used for audio transfers simultaneously. 
Alternatively, the special mode comprises placing the PCI bus 120 in a time sliced or time sloned mode as 
described above with reference to Figures 1 1 and 12. In another embodiment, the special or real time mode 
comprises placing the PCI bus 120 in mode for performing periodic multimedia data transfers as described 
above. Other types of multimedia modes may be used as desired. 
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Conclusion 

Therefore, the present invention comprises a novel computer system architecture which increases the 
performance of real-time applications. The computer system includes a PCI local bus and a real-time or 
multimedia bus. The multimedia bus may be used only for periodic data, and either the PCI bus or a separate 
5 control channel is used for addressing and control data. In one embodiment, the multimedia bus comprises two 
or separate channels for video, audio, and communications. A method is also disclosed which provides for 
improved performance of periodic data transfers on the multimedia bus. Distributed and cenn-alized intelligence 
is also included in the various peripheral devices which provide for time slotting and improved data transfer 
performance. 

0 Although the system and method of the present invention has been described in connection with the 

preferred embodiment, it is not intended to be limited to the specific fonn set forth herein, but on the contrary, it 
is intended to cover such alternatives, modifications, and equivalents, as can be reasonably included within the 
spirit and scope of the invention as defmed by the appended claims. 
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Claims 

1 . A computer system, comprising: 
a CPU; 

main memory coupled to the CPU which stores data accessible bv the CPU; 

bridge logic coupled to the CPU and to the main memory, wherein the bridge logic includes a memory 
controller coupled to the main memory and also includes expansion bus interface logic; 
an expansion bus coupled to the bridge logic; 

a multimedia bus coupled to the bridge logic, wherein said multimedia bus includes a plurality of data 
lines for transmitting data; 

a plurality of multimedia devices coupled to said multimedia bus. wherein each of said multimedia 
devices perform operations on said multimedia bus, wherein each of said multimedia devices includes 
muhimedia bus interface logic for accessing said multimedia bus and performing data transfers on said 
multimedia bus; and 

a centralized input/output processor coupled to said multimedia bus which controls operations on the 
multimedia bus, wherein the centralized input/output processor operates to direct data streams on the 
multimedia bus. 



2. The computer system of claim L wherein said centralized mput/ourput processor transmits 
one or more signals on said multimedia bus indicating a multimedia bus transfer 



3. The computer system of claim 2, wherein said centralized input/output processor performs 
addressing and control operations for transfers to be performed on said multimedia bus. 



4. The computer system of claim 1 , wherein said centralized input/output processor comprises a 
memory for storing data rate, data periodicity, data source, and data destination information for said multimedia 
devices. 



5. The computer system of claim 4, wherein said centralized input/output processor includes data 
transfer control logic coupled to said memory which controls transfers on the multimedia bus, wherein said data 
transfer control logic uses said data rate, data periodicity, data source, and data destination information for said 
multimedia devices stored in said memory for controlling said transfers on the multimedia bus. 



6. -Rie computer system of claim I , wherein said multimedia bus is the peripheral component 
interconnect (PCI) bus, 
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7. The computer system of claim 1, wherein said centralized input/output processor is 

programmable. 



8. The computer system of claim 1 , wherein said centralized input/output processor is comprised 
in said bridge logic. 

9. A computer system, comprising: 
a CPU; 

main memory coupled to the CPU which stores data accessible by the CPU; 

bridge logic coupled to the CPU and to the main memory, wherein the bridge logic includes a memory 
controller coupled to the main memory and also includes expansion bus interface logic; 
an expansion bus coupled to the bridge logic; 

a multimedia bus coupled to the bridge logic, wherein said multimedia bus includes a plurality of data 
lines for transmitting data; 

a plurality of multimedia devices coupled to said expansion bus and said multimedia bus, wherein each 
of said multimedia devices perform operations on said expansion bus and said multimedia bus. wherein each of 
said multimedia devices includes expansion bus interface logic for accessing said expansion bus and performing 
data transfers on said expansion bus, and wherein each of said multimedia devices includes multimedia bus 
interface logic for accessing said multimedia bus and performing data transfers on said multimedia bus; and 

a centralized input/output processor coupled to said expansion bus and said multimedia bus which 
controls operations on the expansion bus and the multimedia bus, wherein the centralized input/output processor 
operates to direct data streams on the expansion bus and the multimedia bus. 

10. The computer system of claim 9, wherein said centralized input/output processor performs 
addressing and control operations for transfers to be performed on said expansion bus and said multimedia bus. 

11. The computer system of claim 9. wherein said centralized input/output processor comprises a 
memory for storing data rate, data periodicity, data source, and data destination information for said multimedia 
devices. 



12. The computer system of claim 1 1 , wherein said centralized input/output processor includes 
transfer control logic coupled to said memory which conn-ols transfers on the multimedia bus, wherein said 
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data transfer control logic uses said dau rate, data periodicit>', data source, and data destination information for 
said multimedia devices stored in said memory for controlling said transfers on the multimedia bus. 



13. The computer system of claim 9, wherein said multimedia bus is the peripheral componem 
interconnect (PCI) bus. 



14. The computer system of claim 9, wherein said multimedia bus is the peripheral component 
interconnect (PCI) bus. 



1 5. The computer system of claim 9, wherein said cenn-alized input/output processor is 
programmable. 



16. The computer system of claim 9. wherein said centralized input/output processor is comprised 
in said bridge logic. 
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